140 research outputs found

    Learning Image-Conditioned Dynamics Models for Control of Under-actuated Legged Millirobots

    Full text link
    Millirobots are a promising robotic platform for many applications due to their small size and low manufacturing costs. Legged millirobots, in particular, can provide increased mobility in complex environments and improved scaling of obstacles. However, controlling these small, highly dynamic, and underactuated legged systems is difficult. Hand-engineered controllers can sometimes control these legged millirobots, but they have difficulties with dynamic maneuvers and complex terrains. We present an approach for controlling a real-world legged millirobot that is based on learned neural network models. Using less than 17 minutes of data, our method can learn a predictive model of the robot's dynamics that can enable effective gaits to be synthesized on the fly for following user-specified waypoints on a given terrain. Furthermore, by leveraging expressive, high-capacity neural network models, our approach allows for these predictions to be directly conditioned on camera images, endowing the robot with the ability to predict how different terrains might affect its dynamics. This enables sample-efficient and effective learning for locomotion of a dynamic legged millirobot on various terrains, including gravel, turf, carpet, and styrofoam. Experiment videos can be found at https://sites.google.com/view/imageconddy

    SEM-POS: Grammatically and Semantically Correct Video Captioning

    Full text link
    Generating grammatically and semantically correct captions in video captioning is a challenging task. The captions generated from the existing methods are either word-by-word that do not align with grammatical structure or miss key information from the input videos. To address these issues, we introduce a novel global-local fusion network, with a Global-Local Fusion Block (GLFB) that encodes and fuses features from different parts of speech (POS) components with visual-spatial features. We use novel combinations of different POS components - 'determinant + subject', 'auxiliary verb', 'verb', and 'determinant + object' for supervision of the POS blocks - Det + Subject, Aux Verb, Verb, and Det + Object respectively. The novel global-local fusion network together with POS blocks helps align the visual features with language description to generate grammatically and semantically correct captions. Extensive qualitative and quantitative experiments on benchmark MSVD and MSRVTT datasets demonstrate that the proposed approach generates more grammatically and semantically correct captions compared to the existing methods, achieving the new state-of-the-art. Ablations on the POS blocks and the GLFB demonstrate the impact of the contributions on the proposed method

    CAD -- Contextual Multi-modal Alignment for Dynamic AVQA

    Full text link
    In the context of Audio Visual Question Answering (AVQA) tasks, the audio visual modalities could be learnt on three levels: 1) Spatial, 2) Temporal, and 3) Semantic. Existing AVQA methods suffer from two major shortcomings; the audio-visual (AV) information passing through the network isn't aligned on Spatial and Temporal levels; and, inter-modal (audio and visual) Semantic information is often not balanced within a context; this results in poor performance. In this paper, we propose a novel end-to-end Contextual Multi-modal Alignment (CAD) network that addresses the challenges in AVQA methods by i) introducing a parameter-free stochastic Contextual block that ensures robust audio and visual alignment on the Spatial level; ii) proposing a pre-training technique for dynamic audio and visual alignment on Temporal level in a self-supervised setting, and iii) introducing a cross-attention mechanism to balance audio and visual information on Semantic level. The proposed novel CAD network improves the overall performance over the state-of-the-art methods on average by 9.4% on the MUSIC-AVQA dataset. We also demonstrate that our proposed contributions to AVQA can be added to the existing methods to improve their performance without additional complexity requirements.Comment: Accepted to IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 202

    Epigenetic changes in myelofibrosis:Distinct methylation changes in the myeloid compartments and in cases with <i>ASXL1</i> mutations

    Get PDF
    Abstract This is the first study to compare genome-wide DNA methylation profiles of sorted blood cells from myelofibrosis (MF) patients and healthy controls. We found that differentially methylated CpG sites located to genes involved in ‘cancer’ and ‘embryonic development’ in MF CD34+ cells, in ‘inflammatory disease’ in MF mononuclear cells, and in ‘immunological diseases’ in MF granulocytes. Only few differentially methylated CpG sites were common among the three cell populations. Mutations in the epigenetic regulators ASXL1 (47%) and TET2 (20%) were not associated with a specific DNA methylation pattern using an unsupervised approach. However, in a supervised analysis of ASXL1 mutated versus wild-type cases, differentially methylated CpG sites were enriched in regions marked by histone H3K4me1, histone H3K27me3, and the bivalent histone mark H3K27me3 + H3K4me3 in human CD34+ cells. Hypermethylation of selected CpG sites was confirmed in a separate validation cohort of 30 MF patients by pyrosequencing. Altogether, we show that individual MF cell populations have distinct differentially methylated genes relative to their normal counterparts, which likely contribute to the phenotypic characteristics of MF. Furthermore, differentially methylated CpG sites in ASXL1 mutated MF cases are found in regulatory regions that could be associated with aberrant gene expression of ASXL1 target genes

    Gravity field determination of a Comet Nucleus: Rosetta at P/Wirtanen

    Get PDF
    One of the prime objectives of the Rosetta Radio Science Investigations (RSI) experiment is the determination of the mass, the bulk density and the low degree and order gravity of the nucleus of comet P/Wirtanen, the target object of the international Rosetta mission. The RSI experiment will use the spacecraft's radio carrier frequencies at X-band (8.4 GHz) and S-band (2.3 GHz) in order to measure slight changes of the orbit velocity via the classical Doppler effect induced by the gravity attraction of the comet nucleus. Based on an estimate of the background Doppler noise, it is expected that a mass determination (assuming a representative radius of 700 m and a bulk density of 500 kg/m^3) at an accuracy of 0.1% can be achieved if the spacecraft's orbit is iteratively reduced below 7 km altitude. The gravity field of degree and order two can be detected for reasonable tracking times below 5 km altitude. The major competing forces acting on the spacecraft are the radiation pressure and the gas mass flux from cometary activity. While the radiation pressure may be predicted, it is recommended to begin a gravity mapping campaign well before the onset of outgassing activity (>3.25 AU heliocentric distance). Radial acceleration by water outgassing is larger by orders of magnitude than the accelerations from the low degree and order gravity field and will mask the contributions from the gravity field

    Dried blood spot UHPLC-MS/MS analysis of oseltamivir and oseltamivircarboxylate—a validated assay for the clinic

    Get PDF
    The neuraminidase inhibitor oseltamivir (Tamiflu®) is currently the first-line therapy for patients with influenza virus infection. Common analysis of the prodrug and its active metabolite oseltamivircarboxylate is determined via extraction from plasma. Compared with these assays, dried blood spot (DBS) analysis provides several advantages, including a minimum sample volume required for the measurement of drugs in whole blood. Samples can easily be obtained via a simple, non-invasive finger or heel prick. Mainly, these characteristics make DBS an ideal tool for pediatrics and to measure multiple time points such as those needed in therapeutic drug monitoring or pharmacokinetic studies. Additionally, DBS sample preparation, stability, and storage are usually most convenient. In the present work, we developed and fully validated a DBS assay for the simultaneous determination of oseltamivir and oseltamivircarboxylate concentrations in human whole blood. We demonstrate the simplicity of DBS sample preparation, and a fast, accurate and reproducible analysis using ultra high-performance liquid chromatography coupled to a triple quadrupole mass spectrometer. A thorough validation on the basis of the most recent FDA guidelines for bioanalytical method validation showed that the method is selective, precise, and accurate (≤15% RSD), and sensitive over the relevant clinical range of 5–1,500 ng/mL for oseltamivir and 20–1,500 ng/mL for the oseltamivircarboxylate metabolite. As a proof of concept, oseltamivir and oseltamivircarboxylate levels were determined in DBS obtained from healthy volunteers who received a single oral dose of Tamiflu®

    Extracellular volume quantification in isolated hypertension - changes at the detectable limits?

    Get PDF
    The funding source (British Heart Foundation and UK National Institute for Health Research) provided salaries for research training (FZ, TT, DS, SW), but had no role in study design, collection, analysis, interpretation, writing, or decisions with regard to publication. This work was undertaken at University College London Hospital, which received a proportion of funding from the UK Department of Health National Institute for Health Research Biomedical Research Centres funding scheme. We are grateful to King’s College London Laboratories for processing the collagen biomarker panel
    • …
    corecore